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Firlrt ftf fhp Tnvention 

ES!4 l^- V e» ti o„ re,a,es compressing video data, and more 
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compressing a stream of video data on-the-fly, as the video data streams into the 
computer system. 

Related Art 

, As video data is increasingly used in computer systems m apphcations 

such as video conferencing and video recording, computer systems often cannot 
k eep pace with fte computational —en* of video data. Video data streams 
^ have extremely large bandwidth recuires tha, can tax the capabumes of 
Ten the most high-speed processor to compress the video data for storage, or for 
„ trar.missionacr„ssac„mpu,er„e W or k orate,ephonesyste m . T* —n 
is typically performed by a central processing unit (CPU) in a computer system 
JT. restating loss in image clarity due to the failure of the CPU to Keep pace 
witn the video data. Complex scenes, having many elements that are in motion 
representee greatest challenge because they place a tremendous burden onthe 
1 5 CPU during the compression and data transfer processes. 

A time-consuming step in the compression of video dam is to compute 
differences between successive video frames. A CPU typicaUy computes a 
difference frame by reading a current video frame into memory and computing the 
difference between the current video frame and a previous video frame, whteh 
2 „ ^previouslystoredrntoamemoryinurecomputersystem. Computing^ 
difference typically invoives performing an exclusive-OR operation between the 
curre nt video frame and the previous video frame. In genera,, any funcuon tha 
effectively represents tine difference between two successive video frames can b. 
used with only minor modifications to the related compression algorithm. Hence, 
25 a large number of possible functions can be used to compute the difference 
between successive video frames. 



2 



Inventor: Dean A. Klein 



WW is needed is an apparatus o, a method for off-loading the time- 
fuming .as, of comparing fhe difference between successive frames of v.de„ 
data from the CPU of a computing. 

SUMMARY 

5 Oneembodimentofthepresen,inve„«o»providesanappararusU,a. 
faciUtatescompressionof video da, in a computer system by P— ^ 
videodata Tmsfteesnteoftenoverburdenedcen.ralprocess.ngun.tfromthts 

10 ^-consuming ^^-"^^^ 
videoda*. Uus.oneembodimentofthepresentinven^oncanbecharactenzed 

L toringvideodatafromfhevideoinputport. The apparatus addtttonatly 
15 Ides previousrrarnebuffer.forstormgatieastaponionofaprevtousv.deo 

Lf.mt.evideoinputbnfferandvideoda.fromthepreviousframeb^. 
TKeembodimentaisoinciudesaresu.tbnffercoupledtod.eopera^un.t.for 

storing the result of an operation from the operation umt. 

Another embodiment of the present invention includes a memory 

Jfromamemorythatcontains video data for Ute current vtdeo frame and the 

pK vious video frame. A variation on this embodiment includes a memory 
lupiedtof.ememoryportfors^Urevideodat.whereinthevtdeo^.s 

25 stored to in a current video frame and a difference frame in the memory, h a 
m d a previous video frame in the same location in the memory, allowmg the 
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craren , video frame to be written over the previous video fame. In ye. «*- 
H„ a for a central processing unit of a computer system. 

, j . + „ ort - the orevious frame buffer stores a 
i, of data from the video input port, trie previuu 
stores a block of data from in ^ 

0 ofdatafromtheoperauonumt In tlus embocum . 

^oper.uonbe.weenabiocUofdatafrommevdeotnputportandab 

• de coTeiogic chip of the computer system, m another embodunen, the 
7 llspLofavideoconferencmgsystem. * yet another 

^eleircuitcoup.edbe.eenmevideoinputportandtKev.deomput 
20 buffer. 

DESCRIPTION OF THE FIGURES 
FIG 1 illustrates a computer system including a graphics controller with a 
• • accordance with an embodiment of the present invention. 

25 ^in.oacore.ogic-inaccordancewi.anotberembo.memofme 

present invention. 
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FIG 3 illustrates the internal structure of a portion of the graphics 
controiler tat computes the difference between successive video frames m 
accordance with an embodiment of the present inventton. 

FIG 4 is a block diagram illustrating a memod for compressmg vdeo data 
in a computer system in accordar.ee with an embodiment of the present invention. 

DEFINITIONS 

£simmmssm ^ l - circuit that maps one set of color values to 

another set of color values. 

Q^ZHB^-rrtm** a computational operation on data 

streams through a computer system. 

C 2J e kgi cuni. - circuitry within a computer system that interfaces a 
processor to a memory and a peripheral bus and performs other taeta* 

Bmsmimm - circuitry that computes a difference funcuon between 
15 successive video frame, This difference function may be an exclusive-OR 
operation. 

DETAILED DESCRIPTION OF THE INVENTION 

The following description is presented to enable any person skilled » the 
art t0 make and use the invention, arrd is provided in the context of a particular 
application and its retirements. Various modifications to the disc osed 
embodiments wil, be readily apparent to those skilled in me art, and the general 
principles defined herein may be applied to outer embodiments and app.cat.ons 
without departing from the spirit and scope of the present invention. Thus, the 
25 present invention is no, intended to be limited to the embodiments show., bu, 
t0 be accorded the widest scope consistent with the principles and feahrres 
disclosed herein. 
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r ..- r ^- rf . r.-s.En.H ntinu- t of the Computer System 

HO 1 illustrates a computer system including a graphics controller wrth a 
difference engine ,06 in accordance with an embodiment of the present «— 
The embodiment illustrated in FIG. 1 includes central processmg urn (CPU 1M. 

Ms includes, bu, is not limited to, a microprocessor CPU, a mamframe CPU ^d 
adevicecontrollerCPU. Norih bridge 1 U forms part of the "core .ogrc^ 
computer s ystem. This core logic ties together and ccrdinate soperations of 

— ^m^y that can* used inacomputer system. Bus 116ca.be 
a„ y W of computer system bu, In one embodiment, bus 116 includes a PCI 

,« bUS ' Bus 116 is also coupled to graphics controller 106, which includes a 

difference engine. ,n this embodiment, graphics controller ,06 includes circuitry 
» perform a difference operation between successive video frames. Graphrcs 
controller .06 is also coupled to memory 108 and video unit ,02. Graphrcs 
controller 106 additionally produces video output 1 14, which feeds into a 
20 computer system monitor. 

Memory 108 may be any type of semiconductor memory that may be used 
in a computer system. In one embodiment ofthe present invention, memory ,08 
is a dedicated graphics memory for graphics controller 1 06, which is separate 
from memory 122. In another embodiment, memory 108 and memory ,2 are 
25 part ofthe same memory. In the illustrated embodiment, memory 108 includes an 
areaforstoringunmodified video data 1.0 and an area for storing XORvrdeo 
dam 1 12. to one embodiment, the area for storing unmodified video data 1 10 
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stores a previous frame of unmodified video, and the area for storing XOR video 
data 1 12 stores a difference frame containing the exclusive-OR of a current frame 
and the previous frame. Other embodiments of the present invention may use 
other difference functions besides exclusive-OR. 
5 Video unit 1 02 receives video input 1 00 in analog form and converts it to 

digital form. In the illustrated embodiment, video unit 102 receives video input 
100 in either PAL or NTSC format, and produces digital video data in YUV 
format 104. Video unit 102 may include the BT829 chip produced by Rockwell 
Semiconductor Systems, Inc. of Newport Beach, California. Alternatively, the 
1 0 Rockwell BT848 part may be used to transfer data across a computer system bus 
into system memory or into a video controller's memory. (In some embodiments, 
these may be the same memory). Additionally, video data may be received from 
external sources through serial buses that can stream video data into system 
memory, usually by transferring data across bus 116. These serial buses may 
1 5 include the USB or the IEEE 1 394 bus. 

The embodiment illustrated in FIG. 1 operates as follows. Video input 
100 streams into video unit 102, which converts video input 100 into digital YUV 
data 104. YUV data 104 feeds into graphics controller 106, which produces video 
output 1 14 for display on a computer system monitor. Graphics controller 106 
20 additionally stores unmodified video data into unmodified video data 1 1 0 within 
memory 108. Graphics controller 106 also computes the difference between a 
current video frame and a previous video frame and stores this difference 
information in XOR video data 1 12 in memory 108. This difference information 
is used by CPU 120 to complete the compression process for the video data 
25 stream. 
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Description of a Second Embodiment 

FIG. 2 illustrates a computer system including a graphics controller 
incorporated into a core logic unit 200 in accordance with another embodiment of 
the present invention. This embodiment is similar to the embodiment illustrated 

5 in FIG. 1 , except that graphics controller 1 06 and north bridge 1 1 8 from FIG. 1 
are combined into a single core logic unit with graphics controller 200. 
Additionally, memory 108 and memory 122 from FIG. 1 are combined into a 
single memory 122 in FIG. 2. 

In the embodiment illustrated in FIG. 2, core logic unit 200 includes 

10 circuitry to compute the difference between successive video frames as well as 
circuitry to perform other graphics controller functions. 

The embodiment illustrated in FIG. 2 operates in the same way as the 
embodiment illustrated in FIG. 1, except that in FIG. 2, unmodified video data 
1 10 and XOR video data 1 12 are not stored in a separate graphics memory 108, 

15 but are rather stored in the system memory 122. Hence, CPU 120 does not have 
to reach out across bus 1 16 to retrieve XOR video data 1 12 from a separate 
graphics memory to complete the compression process. It merely has to retrieve 
data the XOR video data 1 12 from the system memory. 



20 Description of Internal Structure of Graphics Controller 

\ FIG. 3 illustrates the internal structure for a portion of a graphics controller 
that computes the difference between successive video frames in accordance with 
an embodiment of the present invention. The circuitry illustrated in FIG. 3 can 
exist in either graphics controller 106 from FIG. 1 or in core logic unit 200 from 
25 FIG. 2. The c ircuitry illust rated in FIG. 3Jn cludes^YUy-data4nput 104, which 
feeds through color space conversion module 302. This module may perform 
color re-mapping on YUV data 104. The output of color space conversion 
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module 302 feeds into video input buffer 304. From video input buffer 304, the 
video data feeds either into XOR unit 308 and multiplexer (MUX) 312. XOR unit 
308 takes another input from previous frame buffer 306 and generates an output, 
which feeds into result buffer 310. Data from result buffer 3 1 0 feeds through 

5 MUX 312 and I/O buffers 316 into memory 108. MUX 312 takes another input 
from other write circuits 314. This allows data to be written to memory 122 from 
other sources. Data read from memory 122 feeds into previous frame buffer 306, 
and then into XOR unit 308. Alternatively, data read from memory 122 may feed 
into other read circuits 315, allowing data to be read from memory 122 by other 

10 sources. Data read from memory 122 may also pass through serializer 330, color 
lookup table 332 and digital-to-analog converter 334 before becoming video 
output 1 14 to a monitor. Serializer 330 converts data read from memory 122 into 
a serial bitstream. This bitstream is modified in color lookup table 332, and is 
ultimately converted into analog form in digital-to-analog converter 334. 

1 5 The circuitry illustrated in FIG. 3 operates as follows. Video data in YUV 

form 104 from video unit 102 streams into video input buffer 304 through color 
space conversion module 302. From video input buffer 304, this video data feeds 
through MUX 3 12 and I/O buffers 316 into unmodified video data 110 within 
memory 122. At the same time, data for a previous frame from unmodified video 

20 data 1 1 0 in memory 1 22 feeds into previous frame buffer 306 through I/O buffer 
316. From previous frame buffer 306, this data feeds into XOR unit 308. XOR 
unit 308 computes the difference between data from the previous frame, stored in 
previous frame buffer 306, and data from the current frame, stored in video input 
buffer 304. The output of XOR unit 308 feeds into result buffer 3 10. From result 

25 buffer 3 1 9, this data feeds through MUX 3 1 2 and I/O buffers 3 1 6 into an area for 
storing XOR video data 1 12 within memory 122. CPU 120 then uses this 
difference information to compress the video data. 
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In one embodiment, data is processed a block at a time through XOR unit 
308, wherein a block includes multiple words of data. 

In the embodiment illustrated in FIG. 3, data for the current frame is 
overwritten over data for the previous frame as the data for the previous frame is 
retrieved into previous frame buffer 306. This allows the frame data to be stored 
in one location without using "ping pong" buffers. 

The embodiment illustrated in FIG. 3 also includes registers for storing 
address A 322 and address B 324. Address A 322 and address B 324 are pointers 
into memory 122 for keeping track of data within unmodified video data 110 and 
XOR video data 112 within memory 122. 

Description of Method for Compressing Video Data 

FIG. 4 is a flow chart illustrating a method for compressing video data in a 
computer system in accordance with an embodiment of the present invention. 
This flow chart is divided into two columns. The column on the left-hand-side 
represents operations of the computational unit, and the column on the right-hand- 
side represents operations of the memory system. In this embodiment, the system 
starts in state 400. From state 400, the computational proceeds state 402. In state 
402, the computational unit receives a stream of data from a current video frame 
from a video source. The computational unit next proceeds to state 404. In state 
404, the computational unit performs a color space conversion on the video data. 
The computational unit next proceeds to state 406. In state 406, the 
computational unit computes a difference frame from a current video frame and a 
previous video frame received from the memory system "on-the-fly" as the 
current video frame streams into the computer system. In one embodiment, this 
difference computation takes place without intervention by the CPU 120. The 
computational unit next proceeds to state 412. In state 412, the computational 
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unit produces compressed video data using the difference frame. The 
computational unit then loops back around to state 402 to process more video 
data. 

From state 400, the memory system proceeds to state 422. In state 422, 
5 the memory system fetches a block of data from the previous frame. This block of 
data is forwarded to the computational unit for use in state 406. The memory 
system next proceeds to state 424, in which the memory system stores the current 
video frame - received from the computational unit in state 404 « into memory 
122. The memory system next proceeds at state 426. In state 426, the memory 
10 system stores the difference frame into memory 122. The memory system then 
loops back around to state 422 to process more video data. 

The foregoing descriptions of embodiments of the invention have been 
presented for purposes of illustration and description only. They are not intended 
15 to be exhaustive or to limit the invention to the forms disclosed. Obviously, many 
modifications and variations will be apparent to practitioners skilled in the art. 
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